1 

A Cramer-Rao Bound for Semi-Blind 
Channel Estimation in 
Redundant Block Transmission Systems 

Yen-Huan Li, Member, IEEE, Borching Su, Member, IEEE, and Ping-Cheng Yeh, Member, IEEE 

Abstract 

A Cramer-Rao bound (CRB) for semi-blind channel estimators in redundant block transmission systems is derived. 
The derived CRB is valid for any system adopting a full-rank linear redundant precoder, including the popular cyclic- 
prefixed orthogonal frequency-division multiplexing system. Simple forms of CRBs for multiple complex parameters, 
either unconstrained or constrained by a holomorphic function, are also derived, which facilitate the CRB derivation 
of the problem of interest. The derived CRB is a lower bound on the variance of any unbiased semi-blind channel 
estimator, and can serve as a tractable performance metric for system design. 

Index Terms 

Cramer-Rao bound (CRB), semi-blind channel estimation, block transmission systems, complex parameters, 
constrained parameters. 

I. Introduction 

We derive a variance lower bound for unbiased semi-blind channel estimators in redundant block transmission 
systems, practical designs of which can be found in [ 1 ] — [ 11]. We formulate the semi -blind channel estimation 
problem as a non-Bayesian parametric estimation problem with constrained parameter space, and derive the con- 
strained Cramer-Rao bound (CRB) for unbiased channel estimators explicitly. The derived bound is valid for any 
full-rank linear redundant precoder, including the popular cyclic-prefixed orthogonal frequency-division multiplexing 
(CP-OFDM) system adopted in IEEE 802.11n [12], IEEE 802.16e [13] and 3GPP-LTE [14]. 

The derived CRB can be used as a tractable performance metric in communication system design as in [15, 16], 
where pilot symbols are designed with respect to the resulted CRBs. Note that the problem settings in [15, 16] are 
different from ours. In [16] the authors consider the non-blind approach instead of the semi-blind one. The authors 
of [15] also focus on the semi-blind approach, but their definition of pilot symbols is not as general as ours (cf. 
(3)), so they do not need to derive a constrained CRB for complex parameters (see Theorem II.2 in this paper). 
Furthermore, they adopt the Bayesian approach and model the channel as a random vector of certain probability 
distribution, while in this paper we adopt a non-Bayesian approach, and the information of channel distribution is 
not required. 
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A CRB is usually viewed as a lower bound of the optimal mean square error (MSE) performance, but this is 
not the case if we do not specify the bias function of estimators. Most of the existing channel estimators, such as 
those proposed in [1]-[11], are possibly biased with unknown bias functions. Since MSE is the sum of the variance 
and the square of the bias of an estimator, an appropriately designed biased estimator may outperform all unbiased 
estimators, and any CRB for unbiased estimators, in terms of MSE [17]— [19]. This is why we focus more on the 
role of CRB as a tractable performance metric rather than a performance lower bound in terms of MSE. 

To calculate the CRB for unbiased semi-blind channel estimators in a wireless communication system, which is 
usually modeled by complex numbers in a discrete-time baseband representation, we need to extend the existing 
results of CRBs for unconstrained and constrained parameters, originally for real parameters [20]-[24], to the 
case of multiple complex parameters. There has been some literature focusing on this topic [25]-[29]. In [25]- 
[28], the derived CRBs for unconstrained and constrained complex parameters, unlike the corresponding CRBs for 
real parameters, are variance lower bounds for any unbiased estimator for a (2n) -dimensional complex parameter 
[0 T H ] T , instead of the original n-dimensional complex parameter of interest. Computational complexity of 
calculating the CRB is increased, and additional calculation is required to extract the CRB of any unbiased estimator 
of 6, which hinders us from obtaining a closed-form or insights when deriving the bounds. In [29], a variance lower 
bound is derived directly for unbiased estimators of for the first time, but the result is in a complicated form 
compared with the well-known CRB for real parameters [20, 21]. 

An additional contribution of this paper is a simplification of CRB formulae for multiple complex parameters. 
Two cases are considered here. In the first case the parameter space is unconstrained; that is, the parameter space 
is the set of all n-dimensional complex vectors. In the second case the parameter space is constrained by some 
holomorphic function. The derived results are simple for two reasons. First, they share exactly the same forms with 
their real counterparts, and thus avoid the use of a double-sized parameter. Second, since the derivation procedure 
is valid for both real and complex parameters, the simple forms enables us to extend existing CRBs in various 
situations, originally for real parameters, to the case of complex parameters without modifying the forms. 

The rest of the paper is organized as follows. In Section II, we derive simple CRBs for unconstrained and 
constrained complex parameters. In Section III, we describe the discrete-time baseband system model of a redundant 
block transmission system, and formulate the semi-blind channel estimation problem as a non-Bayesian parametric 
estimation problem with a constrained parameter space. We then derive the CRB for semi-blind channel estimators 
in Section IV, applying results obtained in Section II. Conclusions are presented in Section V. 

Notation 

Bold-faced lower case letters represent column vectors, and bold-faced upper case letters are matrices. Superscripts 
such as in v*, v T , v H , M" 1 , and denote the conjugate, transpose, conjugate transpose (Hermitian), inverse, 
and Moore-Penrose generalized inverse of the corresponding vector or matrix. The Kronecker product of A and 
B is denoted by A ® B. Matrices I n and mxn denote the n x n identity matrix and the m x n zero matrix, 
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respectively. Notation %, denotes a Toeplitz matrix 

v ••• 

vi ■■ ■• : 

: '•• '•• 

vl '• '• v > 

'•■ '•■ vi 

... v L 

where Vi is the ith element of the L-dimensional vector v. The notation A > B means that A — B is a nonnegative- 
definite matrix. The vector E [v] denotes the expectation of v, and the matrix E [M] denotes the expectation of M . 
The matrix cov(it, v) is defined as E[(« — E [«])(« — E[v]) H ], and cov(v,v) is denoted by cov(v) for brevity. 

II. Simple Forms of CRBs for Complex Parameters 

A. Introduction 

Let y be a sample from some probability density function (pdf) p(y; 0), which belongs to a family of pdf's 
{p(y; 0), € 6}, parametrized by a parameter space 0. The CRB shows that if both y and are rea/ vectors, the 
variance of any unbiased estimator 9(y) of 9 must follow the following inequality. 

cov(0) > J 1 := (E[™ T ])-\ 

where the random vector v(y;0) := d\np(y; 0)/d0 is called the score, and the matrix J := E [w T ] is called 
the Fisher information matrix (FIM) [20, 21]. Sometimes additional deterministic a priori information is available, 
which indicates that G is constrained to some proper subset of the set of all n-dimensional complex vectors. The 
CRB for such cases are derived in [22]-[24]. Note this deterministic a priori information does not result in a 
Bayesian setting. 

Throughout the paper the complex derivative operation is defined as follows. 
Definition ELI (Complex derivative). 

dz ■ 2 \da J d/3J' dz* ' 2 \da 3 dp J 
for any complex function / and complex variable z := a + j/3, a, (3 £ R. 

Remark. The definition is sometimes referred to as Wirtinger's calculus in literature [30], and is widely adapted in 
the fields of complex analysis [30, 31] and matrix analysis [32]. 

We define the complex score and the complex FIM based on Definition ILL 

Definition II.2 (Complex score and complex Fisher information matrix). The complex score is defined as v(y; 6) := 
d\np(y;0)/dO*. The complex Fisher information matrix is defined as J := E[«v ff ]. 
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We assume the regularity condition holds: 

E[v] :=E[d\np(y;9)/d9*} = 0. 
The condition is obtained by differentiating both sides of the equation J p(y; 9)dy = 1 by 0*. 

B. CRB for Unconstrained Complex Parameters 

The CRB for unconstrained complex parameters is a natural consequence of the above definitions. 

Theorem II.l (CRB for unconstrained complex parameters). For any unbiased estimator 9(y) for the parameter 
9, 

cov(0) > J 1 . 

The equality holds if and only if 9 — 9 = J ' v in the mean square sense. 

Proof: We make use of the generalized Cauchy-Schwartz inequality in [33], which says 

cov(y, y) > cov(y, a;)cov(a;, x) _1 cov(a;, y), (1) 
and the equality holds if and only if 

y = cov(y, x)cov(x, x)~ 1 x 

in the mean square sense. The theorem follows by substituting x and y by the score v and the estimator 9, 
respectively. ■ 

C. CRB for Complex Parameters Constrained by a Holomorphic Function 
First we review the definition of holomorphic functions. 

Definition II.3 (Holomorphic function). If a complex function / : C™ i-> C m satisfies the condition 

df 

— — = 

dz H ' 

we call the function a holomorphic function. 

Remark. A holomorphic function is also called an analytic function in complex analysis, because a complex function 
is holomorphic if and only if it is analytic, although the two terms have different definitions [34]. 

In this subsection we consider the case where the parameter space 6 is already known to be constrained by a 
holomorphic function /. That is, 

B :={9 : f(9)=0}. 

The estimator 9{y) is unbiased if E[0(y)] = 9 for all 9 e 6. 

The CRB for complex parameters constrained by a holomorphic function is stated as follows. 
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Theorem II.2 (CRB for complex parameters constrained by a holomorphic function). Let the constraint function 
f be a holomorphic function that maps from C" to C"\ n > m. Assume that df/dO T has full rank. Choose U 
as a matrix with (n — m) orthonormal columns that satisfies (df/dQ T ) U — 0. Then for any unbiased estimator 
6 for the parameter 9, 

cov(0) >U (U H juy^ 11 . 

The equality holds if and only if 9 — = U (U H JU) 1 U H v in the mean square sense. 

Proof: Since the implicit function theorem and the chain rule hold for holomorphic functions, following the 
derivation of [23, Theorem I], we have E[(0 — 0)v*]U = U. The theorem follows by substitute x and y by U H v 
and 0, respectively, into the generalized Cauchy-Schwartz inequality (1). ■ 

Remark. This bound is valid only for parameter spaces constrained by holomorphic functions. Interested reader 
shall refer to [26] for the general case. 

Remark. We call the matrix U the orthonormal complement matrix for convenience in the following sections. 

III. System Model and Problem Formulation 

A. System Model 

A discrete-time baseband model of block redundant communications through a wireless multipath channel is 
presented in this section [35]. 

We model the wireless multipath channel as a finite impulse response (FIR) filter with order L, and the noise 
process as complex additive white Gaussian noise (AWGN) with zero mean and unit variance. We define an (L + l)- 
dimensional complex channel vector h := [ho ... Hl] to represent the channel impulse response. 

At the transmitter side, the source modulation symbols are divided into blocks of M symbols. Each of the block 
is precoded by a P-by-M precoding matrix F. In general P is larger than M in order to mitigate the inter-block 
interference; in this way redundancy is introduced. We set P := M + L throughout this paper. 



Example III.l. In a CP-OFDM system, the P-by-M precoding matrix F is defined as 

W, 



Olx(m-l) II 



Im 

where the M-by-M matrix XV is the normalized inverse discrete Fourier transform (IDFT) matrix. 

We assume the receiver collects N blocks for each time of channel estimation, so it is more convenient to discuss 
N blocks of modulation symbols in a whole. Denote the source modulation symbols by an (MN) -dimensional 
complex vector y/js, the precoder output, or the channel input, is a (PA r )-dimensional complex vector x := 
^(In ® F) s. The positive constant 7 is to normalize the complex random vector s such that E[|si| 2 ] = 1 for 
all i. However, we do not assume any a priori information about the probability distribution of source modulation 
symbols at the estimator. 
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We denote the signal that the receiver observes as a (PN + L) -dimensional complex vector y, which, according 
to the channel model, is defined as 

V ■= VjT h (I N ® F)s + n. (2) 

The noise vector n is a circularly-symmetric complex Gaussian distributed random vector with mean 0(pn+l)xi 
and covariance matrix Ipn+l- 

B. Problem Formulation 

We show that the parameter to be estimated must satisfy a holomorphic constraint function, which is determined 

by 

1) the choice of the redundant precoding matrix, and 

2) the assignment of pilot symbols. 

We will derive the holomorphic constraint function explicitly. 

The (NP + L + 1) -dimensional complex parameter 8 is defined as 

0:= [h H x H ] H , 

where the vectors h and x are the channel vector and the channel input, respectively. Since our focus is on the 
variance of channel estimators, the channel input x is treated as a nuisance parameter [20]. 

We first focus on the constraint imposed by the choice of redundant precoding matrix. We can see from the 
system model that the channel input x must lie in the column space of the matrix (I ® F); equivalently, selecting 
an orthonormal matrix U n spanning the null space of the matrix (J ® F), the channel input x must satisfy 

U»x = 0, 

which is the constraint function due to redundant precoding. 

Then we turn to the constraint due to the assignment of pilot symbols. Here we adopt a general expression that 
by saying there are some pilot symbols in the message vector s, we mean that 

As = c (3) 

for some constant matrix A and constant vector c. 

Example III.2. When the matrix A is obtained by eliminating some rows of an identity matrix, the constraint 
reduces to the ordinary case where some of the source modulation symbols s are assigned some pre-determined 
values. 

By the definition of the channel input x, we have 

A(I® F) 1 x = c, 
which is the constraint function due to the assignment of pilot symbols. 
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In conclusion, the task of a semi-blind channel estimator h(y) is to estimate the channel coefficient vector h 
with deterministic a priori information that the true parameter 6 is in a set 9 defined as 

9 := {6 : 6 e C NP+L+1 ,f(0) = 0} , 



where the constraint function / is 



o 







c 



(4) 





U H 9 

A (I® F) f 

Note that we do not put any constraint on the channel vector h. Since the constraint function / is holomorphic, 
the simple CRB derived in Theorem II. 2 is valid in the following derivations. 

IV. CRB for Semi-Blind Channel Estimators 

We first derive the CRB for unbiased estimators of the parameter vector 0. Since we are interested in the 
performances of semi-blind channel estimators, we then refine the CRB for the channel coefficients h from the 
CRB for unbiased semi-blind channel estimators of 8. 

By the assumption of AWGN, we obtain the complex score as 

d\np{y.O) 



v : = 



09* 



and the complex FIM as 



J := E [vv H ] 



7 



7 



H 



n-H 

'h 



(5) 



Now we turn to the derivation of the orthonormal complement matrix in Theorem II. 2. Taking derivative on the 
overall constraint function (4), we have 

' 

U H 
A{I®F) ] 



df 



o 





The orthonormal complement matrix, which we denote by E, can be chosen to be a block-diagonal matrix 

/ 



E 



E 



(6) 



where E is some orthonormal matrix that satisfies 

U H 

A (I(g> F) f 

According to Theorem II. 2, we have the following CRB for the entire parameter vector 6. 



E = 0. 
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Theorem IV.l (CRB for the unbiased estimators of entire parameter 0). For any unbiased estimator 6{y) for the 
parameter vector 6, 

cov(0) > E (E H JE)~ 1 E H , 
with the FIM defined as in (5), and the orthonormal complement matrix E defined as in (6). 

We then proceed to derive the CRB for unbiased channel estimators. The bound can be obtained as the upper-left 
L-by-L sub-matrix of both sides of the CRB derived above, because if a matrix (A — B) is nonnegative-definite, 
so are its principal submatrices. 

By the fact that the orthonormal complement matrix is block diagonal and its upper-left sub-matrix is the identity 
matrix, we can see that the upper-left L-by-L sub-matrix of the right side of the overall CRB is exactly the same 
as that of the matrix 

(e h jeY 1 = -\ T " 

Therefore, the upper-left L-by-L sub-matrix of the above matrix is the Schur complement of the upper-left L-by- 
L sub-matrix of the matrix (E H JE). By the definition of Schur complement, we have the CRB for any unbiased 
estimator for the channel coefficient vector h: 



T x %,E 



cov(h) 

> i It" 

1 



T h E(E H T h H T h Ey E H T h H 



(7) 



H AH] ; c 



We can further simplify the derived CRB in (7). Note that for any matrix A, the matrix [A (A H A) A 
a projector to the column space of the matrix A. Let U be a matrix with orthonormal columns that satisfies 
U H (ThE) = 0. We have the following CRB for unbiased semi-blind channel estimators. 

Theorem IV.2 (CRB for unbiased semi-blind channel estimators). For any unbiased semi-blind channel estimator 

h(y), 

cov{h)>±-(r£uu H T x y\ (8) 

where U is a matrix with orthonormal columns that spans the null space of the matrix (T(h)E). 

The following corollary is obtained by taking traces of both sides of equation (8). 
Corollary (Variance lower bound for semi-blind channel estimators). For any unbiased semi-blind channel estimator 

h(y), 



E\\h-hf> 



' i=0 



(9) 



where a e is the l-th largest singular value of the matrix [T^ f ^JJ^. 



Remark. The channel input x has been substituted by the vector (I (g> F)s in order to explicitly show the effect of 
the choice of precoding matrix to the value of CRB. 
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V. Conclusions 

We have extended conventional CRBs, originally for real unconstrained and constrained parameters [21, 22, 24], 
to the case of multiple complex parameters, with simple forms. The results not only facilitate the derivation of CRB 
for the semi-blind channel estimation problem of interest, but also are expected to be useful for other complex CRB 
derivations. 

Applying the simple complex CRBs, we have derived the CRB for semi-blind channel estimators in redundant 
block transmission systems. The derived CRB is valid for any full-rank linear redundant precoder (LRP), including 
the popular CP-OFDM system. The derived CRB is a lower bound on the variance of any unbiased semi-blind 
channel estimator, and can serve as a tractable performance metric for system design. 
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